Hybrid wireless streaming solution, switching from 2d to 3d based on an intuitive hand gesture in virtual reality or augmented reality (ar) head-mounted displays (hmd)

ABSTRACT

A computer game can be viewed on a TV through an augmented reality (AR) head-mounted display (HMD). The wearer can make a gesture such as a first to cause the HMD to present 2D rectangles and 3D objects representing locations in the room that the game can be “presented” in. The wearer may then open his hand and “cast” toward one of the room locations, and the game is transferred to the HMD for presentation in the associated rectangle (in 2D) or 3D object (in 3D).

FIELD

The application relates generally to hybrid wireless streaming solutionsfor switching from 2D to 3D based on an intuitive hand gesture in ARHMD.

BACKGROUND

Computer simulations such as computer games frequently employhead-mounted displays (HMD) for purposes of presenting virtual reality(VR) and augmented reality (AR) experiences. As understood herein, ascomputer games grow more sophisticated, greater interactivity in thereal world in which an AR or VR game is being played may be desirable.

SUMMARY

Accordingly, an assembly includes at least one processor configured withinstructions executable to present a computer simulation on at least afirst display. The instructions also are executable to receiveuser-generated input, and responsive to the user-generated input, switchpresenting the computer simulation to a head-mounted display (HMD)different from the first display.

The computer simulation may include a computer game and the firstdisplay can include a TV.

In some examples, the input may include at least one image of at leastone gesture in free space.

In non-limiting examples, the instructions may be executable to presenton the HMD at least one graphic corresponding to a location in a spaceat which the computer simulation can be emulated to be presented. Insuch examples the instructions can be executable to present on the HMDthe graphic responsive to first input. In example implementations thegraphic includes a three dimensional (3D) object and the instructionsare executable to, responsive to the user-generated input beingassociated with the 3D object, switch a presentation mode from animage-based mode to an object-based mode, and stream objects in theobject-based mode to the HMD for presentation of the objects on the HMDin in a portion of the HMD indicated by the 3D object. If desired, theinstructions can be executable to pause the computer simulation betweenreceiving the user-generated input and commencing streaming the objectsto the HMD.

In other example embodiments the graphic may include a two dimensional(2D) object and the instructions may be executable to compressinformation in an image-based mode, and stream the information to theHMD for presentation of the information on the HMD in in a portion ofthe HMD indicated by the 2D object. In such embodiments the instructionscan be executable to pause the computer simulation between receiving theinput and commencing streaming the information to the HMD.

Objects may be streamed in the object-based mode to the HMD based atleast in part on a direction of gaze such that only objectscorresponding to the direction of gaze are streamed.

The processor may be implemented by a dongle for legacy deviceapplications.

In another aspect, an assembly includes at least one video display, atleast one head-mounted display (HMD), and at least one processorconfigured with instructions for presenting a computer simulation on thevideo display. The instructions also are executable for, responsive toat least one hand gesture in free space, shifting presentation of thecomputer simulation from the video display to the HMD.

In another aspect, a method includes presenting a video simulation on avideo display, identifying at least a first gesture, and responsive tothe first gesture, presenting the video simulation on at least onehead-mounted display (HMD).

The details of the present application, both as to its structure andoperation, can best be understood in reference to the accompanyingdrawings, in which like reference numerals refer to like parts, and inwhich:

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an example system including an example inaccordance with present principles;

FIG. 2 is an illustration of a player wearing a head-mounted display(HMD) and operating a video game controller to play a video game beingpresented on a real-world display such as a TV;

FIGS. 3 and 4 illustrate example images that may be presented on the HMDof FIG. 2 to inform the player of available locations in the room towhich presentation of the video game on the TV may be transferred;

FIG. 5 is a flow chart of example logic attendant to FIGS. 3 and 4;

FIG. 6 illustrates a series of example gestures in free space that theplayer may make to transfer presentation of the game from the TV toemulated locations in the room;

FIG. 7 is a flow chart of example logic attendant to FIG. 6;

FIG. 8 illustrates a legacy TV embodiment using a HDMI dongle; and

FIG. 9 illustrates an AR graphics display consistent with presentprinciples.

DETAILED DESCRIPTION

This disclosure relates generally to computer ecosystems includingaspects of consumer electronics (CE) device networks such as but notlimited to computer game networks. A system herein may include serverand client components including HMDs which may be connected over anetwork such that data may be exchanged between the client and servercomponents. The client components may include one or more computingdevices including game consoles such as Sony PlayStation® or a gameconsole made by Microsoft or Nintendo or other manufacturer, virtualreality (VR) headsets, augmented reality (AR) headsets, portabletelevisions (e.g. smart TVs, Internet-enabled TVs), portable computerssuch as laptops and tablet computers, and other mobile devices includingsmart phones and additional examples discussed below. These clientdevices may operate with a variety of operating environments. Forexample, some of the client computers may employ, as examples, Linuxoperating systems, operating systems from Microsoft, or a Unix operatingsystem, or operating systems produced by Apple, Inc. or Google. Theseoperating environments may be used to execute one or more browsingprograms, such as a browser made by Microsoft or Google or Mozilla orother browser program that can access websites hosted by the Internetservers discussed below. Also, an operating environment according topresent principles may be used to execute one or more computer gameprograms.

Servers and/or gateways may include one or more processors executinginstructions that configure the servers to receive and transmit dataover a network such as the Internet. Or, a client and server can beconnected over a local intranet or a virtual private network. A serveror controller may be instantiated by a game console such as a SonyPlayStation®, a personal computer, etc.

Information may be exchanged over a network between the clients andservers. To this end and for security, servers and/or clients caninclude firewalls, load balancers, temporary storages, and proxies, andother network infrastructure for reliability and security. One or moreservers may form an apparatus that implement methods of providing asecure community such as an online social website to network members.

A processor may be any conventional general-purpose single- ormulti-chip processor that can execute logic by means of various linessuch as address lines, data lines, and control lines and registers andshift registers.

Components included in one embodiment can be used in other embodimentsin any appropriate combination. For example, any of the variouscomponents described herein and/or depicted in the Figures may becombined, interchanged or excluded from other embodiments.

“A system having at least one of A, B, and C” (likewise “a system havingat least one of A, B, or C” and “a system having at least one of A, B,C”) includes systems that have A alone, B alone, C alone, A and Btogether, A and C together, B and C together, and/or A, B, and Ctogether, etc.

Now specifically referring to FIG. 1, an example system 10 is shown,which may include one or more of the example devices mentioned above anddescribed further below in accordance with present principles. The firstof the example devices included in the system 10 is a consumerelectronics (CE) device such as an audio video device (AVD) 12 such asbut not limited to an Internet-enabled TV with a TV tuner (equivalently,set top box controlling a TV). The AVD 12 alternatively may also be acomputerized Internet enabled (“smart”) telephone, a tablet computer, anotebook computer, a HMD, a wearable computerized device, a computerizedInternet-enabled music player, computerized Internet-enabled headphones, a computerized Internet-enabled implantable device such as animplantable skin device, etc. Regardless, it is to be understood thatthe AVD 12 is configured to undertake present principles (e.g.,communicate with other CE devices to undertake present principles,execute the logic described herein, and perform any other functionsand/or operations described herein).

Accordingly, to undertake such principles the AVD 12 can be establishedby some or all of the components shown in FIG. 1. For example, the AVD12 can include one or more displays 14 that may be implemented by a highdefinition or ultra-high definition “4K” or higher flat screen and thatmay be touch-enabled for receiving user input signals via touches on thedisplay. The AVD 12 may include one or more speakers 16 for outputtingaudio in accordance with present principles, and at least one additionalinput device 18 such as an audio receiver/microphone for enteringaudible commands to the AVD 12 to control the AVD 12. The example AVD 12may also include one or more network interfaces 20 for communicationover at least one network 22 such as the Internet, an WAN, an LAN, etc.under control of one or more processors 24. A graphics processor 24A mayalso be included. Thus, the interface 20 may be, without limitation, aWi-Fi transceiver, which is an example of a wireless computer networkinterface, such as but not limited to a mesh network transceiver. It isto be understood that the processor 24 controls the AVD 12 to undertakepresent principles, including the other elements of the AVD 12 describedherein such as controlling the display 14 to present images thereon andreceiving input therefrom. Furthermore, note the network interface 20may be a wired or wireless modem or router, or other appropriateinterface such as a wireless telephony transceiver, or Wi-Fi transceiveras mentioned above, etc.

In addition to the foregoing, the AVD 12 may also include one or moreinput ports 26 such as a high definition multimedia interface (HDMI)port or a USB port to physically connect to another CE device and/or aheadphone port to connect headphones to the AVD 12 for presentation ofaudio from the AVD 12 to a user through the headphones. For example, theinput port 26 may be connected via wire or wirelessly to a cable orsatellite source 26 a of audio video content. Thus, the source 26 a maybe a separate or integrated set top box, or a satellite receiver. Or,the source 26 a may be a game console or disk player containing content.The source 26 a when implemented as a game console may include some orall of the components described below in relation to the CE device 44.

The AVD 12 may further include one or more computer memories 28 such asdisk-based or solid state storage that are not transitory signals, insome cases embodied in the chassis of the AVD as standalone devices oras a personal video recording device (PVR) or video disk player eitherinternal or external to the chassis of the AVD for playing back AVprograms or as removable memory media. Also in some embodiments, the AVD12 can include a position or location receiver such as but not limitedto a cellphone receiver, GPS receiver and/or altimeter 30 that isconfigured to receive geographic position information from a satelliteor cellphone base station and provide the information to the processor24 and/or determine an altitude at which the AVD 12 is disposed inconjunction with the processor 24. The component 30 may also beimplemented by an inertial measurement unit (IMU) that typicallyincludes a combination of accelerometers, gyroscopes, and magnetometersto determine the location and orientation of the AVD 12 in threedimensions.

Continuing the description of the AVD 12, in some embodiments the AVD 12may include one or more cameras 32 that may be a thermal imaging camera,a digital camera such as a webcam, and/or a camera integrated into theAVD 12 and controllable by the processor 24 to gather pictures/imagesand/or video in accordance with present principles. Also included on theAVD 12 may be a Bluetooth transceiver 34 and other Near FieldCommunication (NFC) element 36 for communication with other devicesusing Bluetooth and/or NFC technology, respectively. An example NFCelement can be a radio frequency identification (RFID) element.

Further still, the AVD 12 may include one or more auxiliary sensors 37(e.g., a motion sensor such as an accelerometer, gyroscope, cyclometer,or a magnetic sensor, an infrared (IR) sensor, an optical sensor, aspeed and/or cadence sensor, a gesture sensor (e.g. for sensing gesturecommand), etc.) providing input to the processor 24. The AVD 12 mayinclude an over-the-air TV broadcast port 38 for receiving OTA TVbroadcasts providing input to the processor 24. In addition to theforegoing, it is noted that the AVD 12 may also include an infrared (IR)transmitter and/or IR receiver and/or IR transceiver 42 such as an IRdata association (IRDA) device. A battery (not shown) may be providedfor powering the AVD 12, as may be a kinetic energy harvester that mayturn kinetic energy into power to charge the battery and/or power theAVD 12.

Still referring to FIG. 1, in addition to the AVD 12, the system 10 mayinclude one or more other CE device types. In one example, a first CEdevice 44 may be used to send computer game audio and video to the AVD12 via commands sent directly to the AVD 12 and/or through thebelow-described server while a second CE device 46 may include similarcomponents as the first CE device 44. In the example shown, the secondCE device 46 may be configured as a computer game controller manipulatedby a player or an HMD worn by a player 47. In the example shown, onlytwo CE devices 44, 46 are shown, it being understood that fewer orgreater devices may be used. A CE device herein may implement some orall of the components shown for the AVD 12. Any of the components shownin the following figures may incorporate some or all of the componentsshown in the case of the AVD 12.

Now in reference to the afore-mentioned at least one server 50, itincludes at least one server processor 52, at least one tangiblecomputer readable storage medium 54 such as disk-based or solid statestorage, and at least one network interface 56 that, under control ofthe server processor 52, allows for communication with the other devicesof FIG. 1 over the network 22, and indeed may facilitate communicationbetween servers and client devices in accordance with presentprinciples. Note that the network interface 56 may be, e.g., a wired orwireless modem or router, Wi-Fi transceiver, or other appropriateinterface such as, e.g., a wireless telephony transceiver.

Accordingly, in some embodiments the server 50 may be an Internet serveror an entire server “farm”, and may include and perform “cloud”functions such that the devices of the system 10 may access a “cloud”environment via the server 50 in example embodiments for, e.g., networkgaming applications. Or, the server 50 may be implemented by one or moregame consoles or other computers in the same room as the other devicesshown in FIG. 1 or nearby.

FIG. 2 illustrates an example in which the user 47 in FIG. 1 is shownwearing the HMD 46 while playing a computer simulation such as acomputer game displayed on the display 14. The simulation may be sourcedfrom a game console 44 and/or cloud server 50 and may be controlled bymanipulation of a computer game controller 200. One or more cameras 202may be implemented by the display 14 and/or console 44 and/or otherdevice to image the user 47. The HMD 46 may include one or more sensors204 such as cameras to image both the external space and the eyes of theuser 47.

With the above in mind, reference is now made to FIG. 3, in which an HMDdisplay portion 300 enables the user 47 to see through the displayregion 300 the display 14, labeled 14A in FIG. 3. Assume that the useris a playing a game via the console 44 connected to the display 14 whilewearing an AR HMD device. The AR HMD device is thus providing a view ofthe real world, showing at 14A the image of the real display 14presenting a game being played. The user can look around the real roomand the AR HMD presents suitable flat surfaces such as a table 302and/or plain areas where an AR version of the game being played can bevirtually presented. These areas may be highlighted as indicated at 304by augmented virtual graphics applied to the real-world view in the HMD.

FIG. 4 illustrates that two different types of highlighted areas mayappear based on the flat/plain areas in view. For horizontal flat/plainareas like coffee tables, above tables, floor space, on top of couch,etc. a 3D rectangular volume 400 highlight can appear on the HMDindicating that a 3D volume within the real room exists that canaccommodate a 3D AR version of the game being played on the display 14.If the flat/plain area is vertical like a wall, door or side of cabinet,back of couch, etc. (excepting the active display 14 showing the gamebeing played), a 2D vertically orientated rectangle highlight 402 mayappear to highlight a 2D vertically oriented space suitable for avirtual 2D image to mirror the image of the game being shown on thedisplay 14. Both the virtual 3D area 400 and 2D area 402 can be anysize, larger or smaller than the original TV view.

FIG. 5 illustrates overall logic. With the game running normally on theconsole 44 and/or server 50 and being presented on the display 14, dataincluding augmented reality (AR) graphics may be wirelessly streamed tothe HMD 46. The data may include the 2D image (game framebuffer) outputby the simulation and metadata (such as title identification of thesimulation) to the HMD. The 2D image of the game can be used by the HMDto locate the position of the display 14 in space as sensed by thesensors 204 in FIG. 2, which may include IR or RGB cameras. The gamemetadata can be used to assist with launching the appropriate HMDversion of game title being played on the console device.

At block 500, user input is received. In an example, the input includesa gesture in free space, such as a hand gesture, that is imaged and,using image recognition, recognized. If the gesture is recognized as a“switch” gesture, it is interpreted to be a command to switch from a 2Dpresentation mode on the display 14 to another AR mode. If desired, theuser's gaze may be imaged by the HMD sensors and indication thereof sentto the console or server as appropriate at block 502.

Moving to block 504, in response to the gesture the simulation isstopped (paused) on the display 14 and then the game streamed to the HMDfor presentation at a virtual location indicated in FIG. 3 or 4. Onlythe video of the simulation may be paused and audio may continue to beplayed. Further details of ensuing processing are disclosed below.

FIG. 6 illustrates an example “switch” gesture. An example hand gestureinvolves the user reaching out to the direction of the display 14 withfingers spread as indicated at 600, then making a grabbing gesture asindicated at 602 such as one would make grabbing a foam ball andscrunching the foam ball forming a fist. The user then moves his hand,as indicated by the arrow 604, to align with one of the AR highlightedregions shown in FIG. 3 or 4, as indicated at 606. The last phase of thegesture is indicated at 608, showing the user unfurling his hand from afirst into spread fingers again. This gesture signifies a mode switch,to move the game content from displaying on the real display 14 to theAR space in the highlighted region.

Alternatively, a combination of the user's gaze in combination withunaligned hand gesture towards the highlighted region or user's gaze andpressing a button on a controller can initiate the mode change.

When the gesture is recognized, the game playing on the consoletransitions from real display 14 presentation to either AR 3D or AR 2Ddepending on the type of AR highlighted region the user has gesturedtoward. FIG. 7 illustrates further.

Decision diamond 700 indicates that when the user has gestured toward a3D virtual region being presented on the HMD, the logic moves to block702 to pause the simulation. Wireless streaming is switched from videoimage based (TV 2D mode and/or AR 2D modes) to object-based streaming.Eye tracking information also may be received for purposes to be shortlydisclosed.

In this streaming mode, the game's object data (vertices, polygons,textures, etc.) is wirelessly streamed at block 704 to the AR HMDinstead of a compressed video image of the game output image. Ifdesired, presentation of the simulation on the display 14 may cease atblock 706. At block 708 the AR HMD decodes the object data, which may ormay not include pre-rendered data (such as pre-shaded textures) from theconsole (or server) and then render the game view as augmented 3Dvirtual graphics over the real view. The user can now freely move hishead and body around the 3D rectangular region containing the 3D versionof the game and see it from different angles.

During this mode, the game need no longer be displayed on the display 14and the display 14 image may simply show a different graphic image torepresent a target for reentering the TV 2D mode. For example, thedisplay 14 may simply display a 2D rectangle as a highlight.

The same gesture mechanism shown in FIG. 6 can be used to grab, placeand unfurl the AR 3D view of the game (AR 3D mode) to either a ARhighlighted 2D region in the room or back to the real display 14 (whichis showing a 2D rectangular as a highlight region similar to AR 2Dregions).

On the other hand, if the user has gestured toward an AR 2D region atdecision diamond 700, the logic can move to block 710 to implement videoimage based streaming, in which the simulation output (such as theframebuffer) of the simulation is compressed into a video image and sentwirelessly to the AR HMD at block 712. At block 714 the AR HMD displaysthe 2D rectangular image of the game output as augmented graphics overthe real view in the highlighted region.

The gesture of FIG. 6 may be made once again to grab the AR 2D imagegame shown as augmented virtual graphics and switch the mode back to theTV 2D, where the game's 2D output image is no longer shown as augmentedgraphics in the AR HMD, but as a real 2D image on the real display 14 inthe room.

The above system allows for seamless transition of games thatsimultaneously supports TV and AR gameplay and provides an intuitivemechanism for users to switch between the two play modes at theirconvenience. The user may wish to do this if the rest of the familywants to utilize the TV for other content.

Indeed, using principles above the AR HMD user can grab the TV gameimage into his fist, walk into another room, and place the game as avirtual TV on a bedroom wall to continue playing the game in anotherroom.

During the transition from game modes (TV 2D, AR 2D and AR 3D) the gamesystem may signal the game to pause the running content such thatgameplay is unaffected by the mode switch. Therefore, the system sendsan un-pause to the game once the game view has switched into its targetmode.

Note further that eye tracking may be used to conserve bandwidth.Specifically, when streamlining the simulation to the HMD, only objectsin the direction of gaze of the user need be streamed to the virtuallocation the user is looking at, and other objects in the game need notbe streamed.

It is to be understood that the logical operations herein may beperformed by any device or combination of devices described herein,including the embodiment that is the subject of FIGS. 8 and 9, in whicha dongle 800 such as a high definition multimedia interface (HDMI)dongle is communicatively engaged with a legacy cable or satellite settop box 802 that may output computer simulations to a legacy TV 804 via,e.g., one or more HDMI links. The dongle 800 contains circuitry todecode HDMI content from the STB 802, encode images therefrom, and thenwirelessly stream the encoded images to the HMD.

As shown in FIG. 8, the dongle executing present logic wirelesslystreams, on the HMD 46, indications shown in dashed lines in FIG. 8 ofvirtual areas corresponding to real regions in the room at which theuser can shift presentation of a computer simulation according toprinciples described herein. Specifically, in FIG. 8 a 3D box 806 isshown superimposed on a real table 808 to indicate that the simulationmay be shifted from the TV 804 to be streamed from the dongle to the HMDto be virtually presented in 3D in the box 806 by the HMD. Also, a 2Dplane 810 is shown superimposed on a real wall 812 to indicate that thesimulation may be shifted from the TV 804 to be streamed from the dongleto the HMD to be virtually presented in 2D in the plane 810 by the HMD.

FIG. 9 illustrates that the user from FIG. 8 may move to a hallway 900or other room location and the dongle 800 may stream to the HMDindications 902 of content detected by the dongle to be available in theset top box. In the example shown, the indications 902 are rectanglespresented on the HMD over real walls with each indication being, forexample, a thumbnail or video representing a respective piece of contentavailable from the STB.

FIG. 9 also indicates the user's gaze point 904 as detected by eyetracking using a camera on the HMD. Only the indication 906 in which thegaze point is located need be streamed to the HMD, with the otherindications 902 not being streamed unless and until the user's gazefalls within their respective areas. This saves streaming bandwidth. Asindicated by the image 908 of the user's hand, when the user's handnears an indication 902/906, a visible indicator 910 such as a flash maybe presented in the indication by the HMD to indicate to the user whichindication he is approaching.

It will be appreciated that whilst present principals have beendescribed with reference to some example embodiments, these are notintended to be limiting, and that various alternative arrangements maybe used to implement the subject matter claimed herein.

1. An assembly, comprising: at least one processor configured withinstructions executable to: present a computer simulation on at least afirst display; receive user-generated input; and responsive to theuser-generated input, switch presenting the computer simulation to ahead-mounted display (HMD) different from the first display.
 2. Theassembly of claim 1, wherein the computer simulation comprises acomputer game and the first display comprises a TV.
 3. The assembly ofclaim 1, wherein the input comprises at least one image of at least onegesture in free space.
 4. The assembly of claim 1, wherein theinstructions are executable to: present on the HMD at least one graphiccorresponding to a location in a space at which the computer simulationcan be emulated to be presented.
 5. The assembly of claim 4, wherein theinstructions are executable to present on the HMD the graphic responsiveto first input.
 6. The assembly of claim 5, wherein the graphiccomprises a three-dimensional (3D) object and the instructions areexecutable to: responsive to the user-generated input being associatedwith the 3D object, switch a presentation mode from an image-based modeto an object-based mode; and stream objects in the object-based mode tothe HMD for presentation of the objects on the HMD in in a portion ofthe HMD indicated by the 3D object.
 7. The assembly of claim 6, whereinthe instructions are executable to: pause video of the computersimulation between receiving the user-generated input and commencingstreaming the objects to the HMD while continuing to play audio of thecomputer simulation.
 8. The assembly of claim 4, wherein the graphiccomprises a two-dimensional (2D) object and the instructions areexecutable to: compress information in an image-based mode; and streamthe information to the HMD for presentation of the information on theHMD in a portion of the HMD indicated by the 2D object.
 9. The assemblyof claim 1, wherein the processor is implemented by a dongle.
 10. Theassembly of claim 6, wherein the instructions are executable to: streamobjects in the object-based mode to the HMD based at least in part on adirection of gaze such that only objects corresponding to the directionof gaze are streamed.
 11. An assembly comprising: at least one videodisplay; at least one head-mounted display (HMD); and at least oneprocessor configured with instructions for: presenting a computersimulation on the video display; and responsive to at least one handgesture in free space, shifting presentation of the computer simulationfrom the video display to the HMD.
 12. The assembly of claim 11, whereinthe hand gesture comprises a firsthand gesture and the instructions areexecutable for: responsive to a secondhand gesture, present on the HMDvisual indication of a location in a space to which presentation of thecomputer simulation may be emulated to be shifted.
 13. The assembly ofclaim 12, wherein the secondhand gesture is received prior to thefirsthand gesture, and the instructions are executable for: shiftingpresentation of the computer simulation from the video display to theHMD responsive to the firsthand gesture indicating the location in thespace.
 14. The assembly of claim 11, wherein the computer simulationcomprises a computer game and the video display comprises a TV.
 15. Theassembly of claim 12, wherein the visual indication comprises athree-dimensional (3D) object and the instructions are executable for:responsive to the firsthand gesture being associated with the locationin the space, switching a presentation mode from an image-based mode toan object-based mode; and streaming objects in the object-based mode tothe HMD for presentation of the objects on the HMD in in a portion ofthe HMD indicated by the 3D object.
 16. The assembly of claim 15,wherein the instructions are executable for: pausing the computersimulation between imaging the firsthand gesture and commencingstreaming the objects to the HMD.
 17. The assembly of claim 12, whereinthe visual indication comprises a two-dimensional (2D) object and theinstructions are executable for: compressing information in animage-based mode based at least on part on a direction of gaze; andstreaming the information to the HMD for presentation of the informationon the HMD in a portion of the HMD indicated by the 2D object.
 18. Theassembly of claim 11, wherein the processor is implemented by a dongle.19. A method, comprising: presenting a video simulation on a videodisplay; identifying at least a first gesture; and responsive to thefirst gesture, presenting the video simulation on at least onehead-mounted display (HMD).
 20. The method of claim 19, comprising:responsive to the first gesture, stop presenting the video simulation onthe video display; and responsive to receiving a second gesture prior tothe first gesture, presenting on the HMD an indication of at least onelocation at which the video presentation may be presented.